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(54) METHOD AND DEVICE FOR EXTRACTING CONTOUR 

(57)Abstract: 

PURPOSE: To provide a contour extracting method and device capable of 
automatically, accurately and quickly extracting the contour of an object in 
a picture correspondingly to a color picture with a large size or picture 
data expressed by various colorimetric systems. 

CONSTITUTION: Plural specified points indicating the rough contour of a 
part expressing an object in a color picture are inputted, an area with 
prescribed width along an approximate outline obtained by interpolating 
the plural specified points is extracted from contour candidate points 
having high probability of points on the contour of the object as a 
boundary area, the features of the picture on respective contour 
candidate points are evaluated based upon picture data expressing the 
colors of respective contour candidate points included in the boundary 
area and picture elements existing in the vicinity of the points, and a 
contour point existing in the contour of the object is detected from plural 
contour candidate points based upon the obtained evaluated results to 
extract the contour of the object. 
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JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2. **** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]An input of two or more designated points which show an outline with a rough 
portion showing an object in a color picture is received, A field of predetermined width 
which meets an approximation outline produced by interpolating during said two or more 
designated points is extracted as a border area which consists of a high outline candidate 
point of a possibility of being a point on an outline of said object, Based on image data 
showing a color of each outline candidate point contained in said border area, and a pixel 
of the neighborhood, An outline extraction method extracting an outline of said object by 
detecting a contour point located on an outline of said object out of said outline 
candidate point based on an evaluation result obtained by evaluating the feature of a 
picture in said each outline candidate point. 

[Claim 2]In the outline extraction method according to claim 1, an input of image data 
which shows a typical color in an object part in a color picture and its background parts .s 
received, Change image data of each pixel corresponding to an outline candidate point 
into a color system in which additive color mixing is materialized if needed, and as a 
feature of a picture in said each outline candidate point, An outline extraction method 
asking for a mixed-colors ratio at the time of a mixed-colors model using image data 
which shows a typical color of said object part and background parts express.ng .mage 
data of an applicable pixel. 

[Claim 3]An outline extraction method changing image data of each pixel corresponding 
to an outline candidate point into a color system in uniform color space if needed, and 
evaluating a rate of change of a color [ / near said each outline candidate po.nt ] as a 
feature of a picture in said each outline candidate point in the outline extracts method 
according to claim 1. 

[Claim 4]It is located on an approximation outline produced in an outline extraction 
method of claim 1 by interpolating during two or more designated points as a border area, 
A meeting of an outline candidate point is extracted for image data of a pixel contamed to 
two or more sample points which it left two or more pixels at a time, respectively, and a 
predetermined field of the circumference. Based on an evaluation result of the feature 
corresponding to said each outline candidate point, out of an outline cand.date po.nt 
corresponding to said two or more sample points. An outline extraction method 
extracting an outline which detected a sample of a contour point located on an objective 
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outline, respectively, interpolated between samples of a detected contour point, and 
continued. 

[Claim 5]An outline extracting apparatus which extracts an outline of a portion showing 
an object in said color picture based on image data showing a color of each pixel which 
constitutes the whole color picture held at an image holding means (101), comprising: 
A designated point input means (111) which inputs two or more designated points which 
show a rough outline of said object in said color picture. 

A border area extraction means (112) to extract image data of each pixel contained in a 
border area of predetermined width which meets an approximation outline produced by 
interpolating during said two or more designated points according to an input of two or 
more of said designated points from said image holding means (101) as image data of an 
outline candidate point. 

The feature evaluation methods (113) which evaluate the feature of a picture in sa.d 
outline candidate point based on image data extracted by said border area extraction 
means (112). 

An outline detection means (114) which detects a contour point located on an outl.ne ot 
said object out of said outline candidate point based on an evaluation result by sa,d 
feature evaluation methods (113). 

[Claim 6]In the outline extracting apparatus according to claim 5, the feature evaluation 
methods (113), A color set input means (121) which inputs image data wh.ch shows a 
typical color in an object part in a color picture, and its background parts as a color of 
object and a background color, respectively, The 1st color system conversion method 

(122) that changes image data of each outline candidate point inputted from a border 
area extraction means (112) into image data of a color system in which addifve color 
mixing is materialized according to an input of converting instruction, Based on a 
conversion result by said 1 st color system conversion method (1 22), with a mixed-co ors 
model using said color of object and said background color. An outline extracting 
apparatus being the composition provided with a mixed-colors ratio calculating means 

(123) which computes a mixed-colors ratio at the time of expressing image data .mage 
data of each outline candidate point, and is sent out to an outline detection means (1 1 4) 
as a feature value corresponding to each outline candidate po.nt. 

[Claim 7]The outline extracting apparatus comprising according to claim 5: 
The 2nd color system conversion method (131) that changes into image data of a color 
system in uniform color space image data of each outline candidate point when the 
feature evaluation methods (113) are inputted from a border area extract.cn means (112) 
according to an input of converting instruction. 

A rate calculating means (132) of a color change which computes a rate of change of a 
color [ / near said each outline candidate point ]. and is sent out to an outline detect.on 
means (1 1 4) as a feature corresponding to said each outline candidate pent based on a 
conversion result by said 2nd color system conversion method (131). 
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[Claim 8]In the outline extracting apparatus according to claim 7, a rate calculating 
means (132) of a color change, An outline extracting apparatus being the composition 
which computes color difference based on each image data, and outputs the maximum as 
a rate of change of a color about a pair of two or more pixels which only a predetermined 
distance left mutually focusing on each outline candidate point. 

[Claim 9]In the outline extracting apparatus according to claim 7, a rate calculating 
means (132) of a color change, An outline extracting apparatus being the composition 
which computes the sum of a difference value of each ingredient of each image data, and 
outputs the maximum as a rate of change of a color about a pair of two or more pixels 
which only a predetermined distance left mutually focusing on each outline candidate 
point. 

[Claim 10]In the outline extracting apparatus according to claim 5, a border area 
extraction means (112), It is the composition of extracting selectively image data of this 
sample picture element and a pixel of that circumference from an image holding means 
(101) by making a pixel in every [ on an approximation outline ] two or more pixels into a 
sample picture element, An outline extracting apparatus having received a detection 
result by an outline detection means (114) as a sample of a contour point corresponding 
to said sample picture element, having interpolated between samples of said contour 
point, and having an interpolation means (115) whic h detects a continuous outline. 

DETAILED DESCRIPTION 



[Detailed Description of the Invention] 

[mistrial A PP lication]This invention relates to the object outline extraction method at 
the time of extracting an objective portion from a picture. It is related with the outline 
extracting apparatus using this object outline extraction method. 

[0002]When designing a poster, goods, etc. by the design system by a computer, and 
when creating computer graphics, Processing which changes a color, a size, and shape or 
is compounded with other pictures about the object part contained in the color picture 
produced by reading manuscripts, such as a photograph, or the created color p.cture ,s 
performed in many cases. The same processing is widely used for the desktop-publ.sh.ng 
system, the original edition preparing system of printing, etc. 

[0003]In such a computer system, it is easy with improvement in the speed and 
highly-precise-izing of processings, such as a color, change of shape, and composition, 
and realization of the interface between computer personal (human interface) which ,s 
easy to use is demanded. 

[0004]Here. the quality of the picture acquired by various processings mentioned above 
extracting the portion of the target object from a color picture first, and performing 
subsequent processings by the quality of the extracting processing result of this object 
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is influenced greatly. 

[0005] For this reason, the art of extracting the object part specified by an operator from 

a color picture simply and correctly is needed. 

[0006] 

[Description of the Prior Art]An operator specifies the pixels which form the outline of 
the object in the picture displayed on the display device one by one using a mouse or a 
light pen, and the conventional object extraction processing is performed by starting the 
picture inside this outline. 

[0007]Thus, in the way an operator specifies the pixel of an outline, the contour part was 
expanded and displayed and the operator has judged whether it should include in a 
background about each pixel near the boundary of an object and a background, or it 
should include in an object. 

[0008]Here, in fields, such as printing and publication, the size of one screen is 
dramatically large and big image data (4000 pixels x about 4000 pixels) is common. For 
this reason, it is difficult to be unable to display the whole screen at once, either and to 
read the whole image data into a main memory unit before it in the display device with 
which the personal computer etc. were equipped. 

[0009]Therefore, in this field, the picture was selectively read into main memory, it 
displayed on the display device and the operator was performing manually specification 
of the outline mentioned above about the displayed portion. 

[0010]Paying attention to attributes, such as an objective color, the method of extracting 
the portion which has the same attribute as an objective portion is also proposed. When 
this method is used, by specifying the range of the color which an operator extracts as 
an object, an applicable portion can be extracted and a certain amount of automation can 
be attained. 

[0011]These people have already applied for Japanese Patent Application No. No. 
275593 [ four to ] "an object contour detection method, object extraction method, and 
image processing device" as a method of automating the processing which extracts an 
objective outline. 

[0012]This technique is aimed at the image data expressed with the color system in 
which additive color mixing is materialized like RGB color coordinates or a CIE standard 
colorimetric system. 

The mixed-colors model by the objective color and the color of a background expresses 
the image data near an objective boundary, and an objective outline is detected based on 
the mixed-colors ratio. 

[0013]Under the influence of 1-pixel size in image sensors with which the picture input 
device was equipped, such as aberration of an optical system, and a CCD element, etc., 
the color (R, G, B) of each pixel near the boundary of an object and a background, As 
shown in formula **, an objective color (Ro, Go, Bo) and the color (Rb, Gb, Bb) of a 
background are considered to be a color acquired by carrying out mixed colors. 
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[0014] 
[Equation 1] 

[§l-x[8] + a-» [8] •••a> 



[0015]Therefore, if a mixed-colors ratio is computed about each pixel contained to this 
field in response to specification of the field of the predetermined width containing an 
objective outline and the pixel of the fixed mixed-colors ratio (for example, a 
mixed-colors ratio is 1:1) is extracted, an objective outline can be extracted 
automatically. 

[0016]As are shown in drawing 7 (a), and the input of two or more pixels is received as a 
designated point which shows an objective rough outline and it is shown in drawing 7 ( b) 
here, If the field of predetermined width is extracted along with the approximate outline 
produced by contracting these designated points one by one, Since the contour 
extraction process which extracted and mentioned the field of objective outline vicinity 
above by specifying two or more pixels which the operator showed to drawing 7 (a) can 
be presented, an operator's work burden is substantially mitigable. 
[0017] 

[Problem(s) to be Solved by the InventionjBy the way. although the outline of the object 
caught with human beings feeling could be certainly extracted in the way an operator 
specifies the pixel of an objective outline that it mentioned above in detail, extract.on of 
a contour part took huge time and the operators processing burden was dramatically 
large For example, in order to extract the outline of portions, such as a car. from a 
picture faithfully, the considerably skilled operator needed to do the work of several 
hours. 

[0018]In particular, in fields, such as printing and publication, since the size of a picture 
was large the excessive burden was placed on the operator in many cases. In the 
method of extracting a portion applicable using an objective attribute, although it was 
possible to have attained a certain amount of automation and to have eased an 
operator's burden, when there was a portion with an attribute similar to background parts, 
it was not able to extract only an objective portion correctly. 

[001 ^Especially the thing for which background parts are eliminated while including 
various portions, such as portions in which an objective portion has a bright color in 
natural pictures, dark portions, etc., such as a photograph, not leaking and extracting 
these portions is dramatically difficult. Since it comprises a portion which usually had 
various attributes, in order to extract as a whole, objects, such as a car. had to specify 
the range of an attribute about each of these portions, and had to compound the 
extracted portion. 

[0020]On the other hand, although the technique of Japanese Patent Application No. No. 
275593 [ four to ] can extract a desired object part from natural pictures in high 
accuracy, The scope is limited to the image data based on the color system in which 



5/24 



Japanese Publication number : 07- 302342A 



additive color mixing is materialized, and cannot be applied to the image data expressed 
with an l_Vb* color system, an L*uV color system, etc. as it is. 

[0021] However, in recent years, the color system of uniform color space, such as an 
LVb* color system and an L*u*v* color system, attracts attention, and the art of 
extracting an objective outline from the picture expressed with such a color system in 
automatic and high accuracy is demanded. 

[0022]Because, in an LVb* color system or an L*uV color system, It is because it is 
advantageous when transmitting image data, since a color picture is compressible by high 
efficiency by compressing each independently since the brightness component and the 
color component are separated clearly. In the field of picture transmissions, such as a 
color facsimile device, the LVb* color system is actually seen as a hopeful as an 
international standard of a color system. 

[0023]Since computational complexity, such as a mixed-colors ratio, will become huge if 
automatic extracting processing of an outline which was mentioned above is applied as it 
is to the image data of large size used in the field of the publishing business etc., the 
extracting processing of an outline will take time. For this reason, the high speed art of 
the contour extraction process is also doubled and searched for. 
[0024]An object of this invention is to provide the outline extraction method and outline 
extracting apparatus for extracting an objective outline automatically corresponding to a 
picture with big size, or the picture expressed with various color systems. It aims at 
providing the outline extraction method and outline extracting apparatus which can be 
extracted at high speed for an objective outline. 

[0025] . . , x *r 

[Means for Solving the Probleml Drawing 1 is a figure showing a principle of an outline 
extraction method of claim 1. An invention of claim 1 receives an input of two or more 
designated points which show an outline with a rough portion showing an object in a color 
picture A field of predetermined width which meets an approximation outline produced 
by interpolating during two or more designated points is extracted as a border area which 
consists of a high outline candidate point of a possibility of being a point on an objective 
outline Based on image data showing a color of each outline candidate point contained in 
a border area, and a pixel of the neighborhood, An objective outline is extracted by 
detecting a contour point located on an objective outline out of an outline candidate 
point based on an evaluation result obtained by evaluating the feature of a picture in 
each outline candidate point. 

[0026]An invention of claim 2 receives an input of image data which shows a typical color 
in an object part in a color picture, and its background parts in the outline extraction 
method according to claim 1, Change image data of each pixel corresponding to an 
outline candidate point into a color system in which additive color mixing is materialized if 
needed and as a feature of a picture in each outline candidate point with a mixed-colors 
model using image data which shows a typical color of an object part and background 
parts It asks for a mixed-colors ratio at the time of expressing image data of an 
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applicable pixel. 

[0027]In the outline extraction method according to claim 1, an invention of claim 3 
changes image data of each pixel corresponding to an outline candidate point into a color 
system in uniform color space if needed, and evaluates a rate of change of a color [ / 
near each outline candidate point ] as a feature of a picture in each outline cand.date 

r0028l Drawing 2 is a figure showing a principle of an outline extraction method of claim 4. 
In an outline extraction method of claim 1, an invention of claim 4 as a border area, It is 
located on an approximation outline produced by interpolating during two or more 
designated points, and a meeting of an outline candidate point is extracted for image data 
of a pixel contained to two or more sample points which it left two or more pixels at a 
time respectively, and a predetermined field of the circumference. Based on an 
evaluation result of the feature corresponding to each outline candidate pent, an outline 
which detected a sample of a contour point located on an objective outline, respectively 
out of an outline candidate point corresponding to two or more sample points, 
interpolated between samples of a detected contour point, and continued is extracted. 
r0Q29l Drawing 3 is a principle block diagram of an outline extracting apparatus of claim 5 
and claim 6. Based on image data showing a color of each pixel which constitutes the 
whole color picture held at the image holding means 101, outline extracting apparatus of 
this invention which extracts an outline of a portion showing an object in a color p.cture 
is characterized by that an invention of claim 5 comprises the following. 
The designated point input means 1 1 1 which inputs two or more designated po.nts which 
show an objective rough outline in a color picture. 

A border area extraction means 1 12 to extract image data of each p.xe. contained in a 
border area of predetermined width which meets an approximation outl.ne produced by 
interpolating during two or more designated points according to an input of two or more 
designated points from the image holding means 101 as image data of an outline 

The ^'revaluation methods 1 1 3 which evaluate the feature of a picture in an outline 
candidate point based on image data extracted by the border area extraction means 11 1. 
The outline detection means 114 which detects a contour point locate on an , object, 
cutline out of an outline candidate point based on an evaluation result by the feature 
evaluation methods 113. 

[0030]ln the outline extracting apparatus according to claim 5. an invention of claim 6 the 
eature eva.uation methods 113, The co.or set input means 121 which inputs ,mage data 
which shows a typical color in an object part in a color picture, and ,ts background parts 
Is a odor of object and a background co.or. respective.y, The 1st co.or system 
conversion method 122 that changes image data of each outline cand.date pent inputted 
from the border area extraction means 112 into image data of a color system in which 
additive color mixing is materialized according to an input of converting mstruction. 
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Based on a conversion result by the 1st color system conversion method 122, with a 
mixed-colors model using a color of object and a background color. A mixed-colors ratio 
at the time of expressing image data image data of each outline candidate point is 
computed, and it is characterized by being the composition provided with the 
mixed-colors ratio calculating means 1 23 sent out to the outline detection means 1 1 4 as 
a feature value corresponding to each outline candidate point. 

r0031l Drawing4 is a principle block diagram of an outline extracting apparatus of claim 7 
thru/or claim 9. In the outline extracting apparatus according to claim 5, an .nvent.on of 
claim 7 the feature evaluation methods 113, The 2nd color system conversion method 
1 31 that changes into image data of a color system in uniform color space .mage data of 
each outline candidate point inputted from the border area extraction means 112 
according to an input of converting instruction, Based on a conversion result by the 2nd 
color system conversion method 131, a rate of change of a color [ / near each outhne 
candidate point ] is computed, and it is characterized by being the composition provided 
with the rate calculating means 132 of a color change sent out to the outline detection 
means 1 1 4 as a feature corresponding to each outline candidate point. 
[0032]In the outline extracting apparatus according to claim 7, an invention of da.m 8 the 
rate calculating means 132 of a color change, It is characterized by be.ng the 
composition which computes color difference based on each image data, and outputs the 
maximum as a rate of change of a color about a pair of two or more p.xels which only a 
predetermined distance left mutually focusing on each outline candidate point. 
[0033]In the outline extracting apparatus according to claim 7, an invention of claim 9 he 
ate alculating means 132 of a color change. It is characterized by being 
composition which computes the sum of a difference value of each mgred.ent o each 
image data, and outputs the maximum as a rate of change of a color about a pa r of two 
or more pixels which only a predetermined distance left mutually focusing on each outline 

[OO^Slis a Prinoiple block diagram of an outline extracting apparatus of claim 
0 In extracting apparatus according to claim 5. an invention of claim 10 the 

border area extraction means 112, It is the composition of extracting se.ect.vely image 
data of this sample picture element and a pixel of that circumference from the image 
holding means 101 by making a pixel in every [ on an approximation outhne ] two or more 
els into a sample picture element. A detection result by the outline detection mean 
114 was received as a sample of a contour point corresponding to a sam le ^tu 
element, between samples of a contour point was interpolated, and it had the 
interpolation means 115 which detects a continuous outline. 

[ 0 F 0 unction]The invention of claim 1 can detect a contour point based on the feature value 
which extracted only the image data corresponding to a pixel with a h.gh poss.b.hty of 
being located on an outline, and computed it about the extracted outhne candidate po.nt 
based on the rough outline shown by a designated point out of the whole image data. 
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[0036]In this case, since only a portion required for outline extraction can be extracted 
from a picture with big size as a border area and calculation processing and outline 
detection processing of a feature value can be presented, corresponding to a picture 
with big size, automatic extracting of an outline can be made possible. 
[0037]The invention of claim 2 can change required sufficient image data into the color 
system in which additive color mixing is materialized, in order to extract an outline using 
the mixed-colors model of a color of object and a background color by presenting 
color-coordinates-transformation processing only with the image data contained in the 
border area shown by a designated point. 

[0038]Thereby, also about the image data of big size expressed with the L*aV color 
system etc., the technique of Japanese Patent Application No. No. 275593 [ four to ] is 
applied, and it becomes possible to extract an objective outline automatically and 
precisely. 

[0039]The invention of claim 3 can express the image data of an outline candidate point 
with the color system of uniform color space, and can extract an outline based on the 
rate of change of the color acquired as a feature value corresponding to each outline 
candidate point. Since the rate of change of the color evaluated in uniform color space 
here is very well equivalent to the rate of change of the color caught with human being's 
feeling based on the rate of change of this color, it becomes possible by detecting an 
outline to extract an outline faithful to the outline of the object caught with human 

being's feeling. . 
[0040]Since the meeting of the outline candidate point corresponding to the sample point 
on an approximation outline is extracted at intervals, the invention of claim 4 can reduce 
the computational complexity which evaluation processing of the feature correspond.ng 
to an outline candidate point takes. It is possible to extract the continuous outhne almost 
equivalent to the case where a continuous border area is extracted by interpolating the 
sample of the contour point detected based on the evaluation result mentioned above. 
[0041]Based on the designated point inputted via the designated point input means 111, 
the border area extraction means 112 can extract only the image data of an outline 
candidate point from the image holding means 101, and the invention of claim 5 can 
present processing by the feature evaluation methods 113 and the outline detection 
means 114 with it. This extracts only a portion required in order to extract an objective 
outline from the image data of the big size accumulated in auxiliary storage units, such as 
a hard disk drive, for example, A contour extraction process can be presented, the 
computational complexity which read-out processing of the image data itself, calculation 
processing of a feature value, etc. take can be reduced substantially, and improvement in 
the speed of processing can be attained. 

[0042]The invention of claim 6 by the 1st color system conversion method 122 with 
which the feature evaluation methods 113 were equipped. Only a portion required for a 
contour extraction process is changed into the color system in which additive color 
mixing is materialized selectively in the whole image data, Processing by the 
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mixed-colors ratio calculating means 123 can be presented, and it can ask for the 
mixed-colors ratio in the mixed-colors model using the color of object and background 
color which were inputted via the color set input means 121 as a feature value of each 
outline candidate point. Thereby, also about the image data of big size expressed with the 
LVb* color system, for example, the technique of Japanese Patent Application No. No. 
275593 [ four to ] is applied, and it becomes possible to extract an objective outline 
automatically and precisely. 

[0043]The invention of claim 7 by the 2nd color system conversion method 131 with 
which the feature evaluation methods 113 were equipped. Only a portion required for a 
contour extraction process can be selectively changed into the color system of uniform 
color space in the whole image data, processing by the rate calculating means 132 of a 
color change can be presented, and the rate of change of a color [ / near each outline 
candidate point ] can be searched for as a feature value corresponding to each. In this 
case evaluation processing of a feature value can be performed using the image data 
expressed with the LVb* color system etc. as it is, and the objective outl.ne which 
suited human being's feeling can be extracted using the character of uniform color space. 
[0044]The invention of claim 8 can estimate precisely change of a color [ / near the 
outline candidate point ], when the rate calculating means 132 of a color change makes 
the maximum of the color difference acquired from the image data correspondmg to the 
pair of two or more pixels centering on an outline candidate point the rate of change of a 

Therefore, it is possible to detect an outline faithful to the outline caught with human 
being's feeling by processing by the outline detection means 114. 

[0045]When the rate calculating means 132 of a color change asks for the sum of the 
difference of each ingredient about the image data corresponding to the pair of two or 
more pixels centering on an outline candidate point and makes the maximum the rate o 
change of a color, the invention of claim 9. The processing which evaluat.cn of the rate of 
change of a color [ / near the outline candidate point ] takes can be simplified, and 
evaluation processing of a feature value can be accelerated. 

[0046]In the invention of claim 10, the border area extraction means 112 extracts the 
image data corresponding to the sample point on an approximation outline, and presents 
processing by the feature evaluation methods 1 13 and the outline detection means 14. 
Therefore, the computational complexity which evaluation processing and outl.ne 
detection processing of a feature value take is substantially reduc.ble. 
In this case, the continuous outline can be obtained, when it is considered as the sample 
of the contour point corresponding to the sample point on the approximation out ne 
which mentioned above the contour point obtained by the outline detection means 114 
and the interpolation means 115 interpolates between the samples of this contour point. 

[ExamplelHereafter. based on a drawing, the example of this invention is described in 
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detail. The example lineblock diagram of the image processing system which applied the 
outline extracting apparatus of claim 6 is shown in drawing 6. 

[0048]In drawing 6 , an image processing system inputs image data with the picture input 
devices 201, such as an image scanner, It once accumulates in the image holding means 
101 which comprised a mass hard disk drive etc., and according to the directions from a 
user, required image data is transmitted to the memory 204 for a display by the 
transmission treating part 203, and it has composition displayed on the display device 
205. 

[0049]This image processing system is provided with the mouse 206 or the keyboard 207 
as an input device for a user to input directions. 

The directions from these input devices are analyzed by the input analyzing parts 208, 
and are transmitted to the extracting processing part 210, the tracking process.ng part 
220. and the image processing portion 230 equivalent to the transmission treating part 
203 or an outline extracting apparatus. 

[0050]The case where the image data of big size (for example. 4000 pixels x 4000 pixels) 
expressed with RGB color coordinates is inputted by the picture input dev.ce 201 
mentioned above, and it is hereafter accumulated in the image holding means 101 by it is 
taken for an example. How to extract the outline of the object specified by a user from 
this image data is explained. 

[0051]In this case, when directions of the purport that the specified p.cture.s displayed 
are received via the input analyzing parts 208, the transmission treating part 203 samples 
the image data of the big size accumulated in the image holding means 101. and shoud 
just reduce it to the size which can be displayed with the display device 205. For example, 
if 1 pixel is sampled from 4 pixels, respectively and it transmits to the memory 204 for a 
display about a scanning direction and a vertical scanning direction, the reduct.on ,mage 
of the size of 1/16 will be obtained. 

[0052]Thus. based on the reduction image displayed on the d.splay dev.ce 205. I.ke the 
technique of Japanese Patent Application No. No. 275593 [ four to ]. a user operates the 
mouse 206 etc. and should just specify two or more points on the rough outline > of the 
object grasped intuitively as a designated point. As shown in dj^wingj_(a), when the pixel 
which hits at the point of inflection of the rough outline mentioned above is specified as 
a designated point at this time, it is convenient for the contour extraction process 

mentioned later. . 7 « Q , rfnilK 
[0053]When applying the technique of Japanese Patent Application No. No. 275593 L four 
to ] in order to create a mixed-colors model about the boundary part of an object and a 
background, it is necessary to receive the input of an objective typical color (a color of 
object is called hereafter) and the typical color (a background color is called hereafter) of 
a background. In this case, a user grasps a color of object and a background color 
intuitively, and should just specify the pixel in which each has appeared by operating the 
mouse 206. 
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[0054]The information which shows the position of the designated point mentioned 
above is sent out to the extracting processing part 210 shown in drawing 6 via the input 
analyzing parts 208, and the coordinates of the applicable pixel in a display screen are 
sent out to the tracking processing part 220 by the input analyzing parts 208 according 
to specification of the pixel corresponding to a color of object and a background color. 
[0055]Thus, when the input analyzing parts 208 send out the position or color of object, 
and background color of a designated point to the extracting processing part 210 and the 
tracking processing part 220 according to operation of the mouse 206 by a user, 
respectively, It has the composition of realizing the function of the designated point input 
means 111 and the color set input means 1 21 . 

[0056]The extracting processing part 210 shown in drawing 6 is a thing equivalent to the 
border area extraction means 1 12, It is formed from the coordinate calculation part 21 1, 
the interpolation processing section 212, the address calculation part 213, and the 
read-out treating part 214, According to the directions from the input analyzing parts 
208, the image data of the pixel near the rough outline mentioned above is read from the 
image holding means 101, and it has composition sent out to the tracking processing part 
220. 

[0057]In the extracting processing part 210, based on the coordinates rece.ved from the 
input analyzing parts 208, each designated point computes the coordinates which show 
the position occupied in the picture of the original size, and sends out the coord.nate 
calculation part 21 1 to the interpolation processing section 21 2. 

[0058]According to this, the interpolation processing section 212 connects each outline 
candidate point in a straight line one by one, for example, searches for all the coordinates 
of the pixel on these line segments, and has composition sent out to the address 
calculation part 21 3 one by one. If the pixel which hits here at the point of inflection of a 
rough outline is specified as a designated point, By contracting these designated po.nts 
with drawing 7 (b) in a straight line, as a dotted line shows, the approximation outline 
approximated to the rough outline mentioned above is obtained, and the coordinates of 
all the pixels on this approximation outline are acquired by this interpolation processing 

section 212. . 
[0059]The address calculation part 213 corresponds to each of the pixel on the 
approximation outline mentioned above, What is necessary is to compute the coordinates 
of the pixel of the predetermined number (for example, 9 pixels) which follows a scanning 
direction and a vertical scanning direction focusing on the pixel, respectively, and just to 
direct to read the image data of the pixel applicable to the read-out treating part 214. 
[0060]In this case, corresponding to each pixel on the obtained approximation outline, by 
the interpolation processing section 212 by the read-out treating part 214. As shading is 
attached and shown in drawing 8 , the image data of the pixel of the cross shape range is 
read from the image holding means 101 as image data of an outline candidate po.nt, and 
is sent out to the tracking processing part 220 one by one. 

[0061]In the tracking processing part 220 shown in drawing 6, the color set attaching part 
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221 has the composition of reading and holding the image data which expresses a color 
of object and a background color from the memory 204 for a display based on the 
coordinates received from the input analyzing parts 208. The mixed-colors ratio 
calculating part 222 and the outline primary detecting element 223 extract an objective 
outline using the technique of Japanese Patent Application No. No. 275593 [ four to ], 
and have composition sent out to the image processing portion 230 via the outline 
attaching part 224. 

[0062]The mixed-colors ratio calculating part 222 mentioned above is equivalent to the 
mixed-colors ratio calculating means 1 23 described by claim 6. 

It substitutes for formula ** which mentioned above the color of object held at the color 
set attaching part 221, and the background color, a mixed-colors model is created, and it 
has composition which computes the mixed-colors ratio k corresponding to each of the 
image data inputted using this mixed-colors model. 

[0063]In this case, since the image data currently held at the image holding means 101 is 
expressed with RGB color coordinates and additive color mixing is materialized, It can 
omit, the function of the feature evaluation methods 113 is realized by the color set 
attaching part 221 and the mixed-colors ratio calculating part 222 which were mentioned 
above, and the 1 st conversion method 1 22 has composition which sends out the obtained 
mixed-colors ratio to the outline primary detecting element 223 equivalent to the outline 
detection means 1 14 one by one. 

[0064]Here, if the size of the cross shape range mentioned above is suitable, the cross 
shape range corresponding to each of the point on an approximation outline certainly 
intersects an objective outline. As Japanese Patent Application No. No. 275593 [ four 
to ] described, an objective outline, Since a color of object and a background color are 
considered to be the meeting of a pixel mixed at a predetermined rate, Based on the 
value of the mixed-colors ratio k obtained by the mixed-colors ratio calculating part 222 
mentioned above, the point (a contour point is called hereafter) on an objective outline is 
detectable by choosing 1 pixel from the outline candidate point corresponding to each of 
the pixel on an approximation outline. 

[0065]For example, the contour point primary detecting element 223 receives the 
mixed-colors ratio k of the outline candidate point corresponding to each pixel on the 
approximation outline mentioned above, and the mixed-colors ratio k detects the outline 
candidate point nearest to 1/2, and should just send out the coordinates of an applicable 
outline candidate point to the contour point attaching part 224 as coordinates of a 
contour point. 

[0066]Thus, by performing processing which each part of the tracking processing part 
220 mentioned above, as shown in drawing 9 , a contour point can be detected from the 
outline candidate point corresponding to each pixel on an approximation outline one by 
one, and the continuous outline can be pursued and extracted along with this 
approximation outline. However, in drawing 9 , cross hairs showed only the range of the 
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outline candidate point corresponding to a designated point, and the display of the outline 
candidate point corresponding to other pixels on an approximation outline was omitted. 
[0067]Here, the set of the outline candidate point mentioned above serves as a border 
area which has as the whole the predetermined width which met the approximation 
outline. That is, by reading the image data of the outline candidate point corresponding to 
each pixel on an approximation outline one by one, as it mentioned above, only the image 
data of the border area mentioned above out of huge image data can be extracted, and 
the contour extraction process using a mixed-colors model can be presented. 
[0068]In this case, since the image data corresponding to **** part can be selectively 
read from the picture of big size, when treating the picture of big size, the processing 
time which increases for reading processing can be suppressed to the minimum. 
[0069]This becomes possible like printing and the publication field to apply the outline 
extraction art in which the mixed-colors model was used for the system treating the 
picture of big size. By having had composition corresponding to each pixel on an 
approximation outline which detects a contour point in quest of a mixed-colors ratio for 
every outline candidate point, detection processing of a contour point and extracting 
processing about the cross shape range corresponding to the following pixel can be 
performed in parallel, and it becomes possible to attain improvement in the speed of a 
contour extraction process. 

[0070]While stopping the quantity of the image data read at once by extracting the pixel 
of the cross shape range as an outline candidate point especially corresponding to each 
pixel on an approximation outline, duplication in the outline candidate point corresponding 
to a nearby pixel can be lessened, and the computational complexity as the whole can be 

reduced. i * 

[0071]It is good also as composition which reads the image data which makes the pixel ot 
the range of the m pixel xm pixel centering on the pixel an outline candidate point, and 
corresponds by the address calculation part 213 and the read-out treating part 214 
corresponding to each pixel on an approximation outline. 

[0072]The rate of change of image data is searched for as a feature value corresponding 
to an outline candidate point instead of asking for a mixed-colors ratio, as it mentioned 
above It is good also as composition which detects the outline candidate point when the 
rate of change of image data serves as the maximum as a contour point, and each 
ingredient of image data may be added, it may ask for a brightness component, and a 
contour point may be extracted paying attention to change of this brightness component. 
[0073]Like an LW color system or an LW color system, When image data is 
expressed with the color system in which additive color mixing is not materialized, as it 
mentioned above, a border area is extracted, and if it changes into the color system in 
which additive color mixing is materialized only about this border area, an objective 
outline can be extracted using the technique of Japanese Patent Application No. No. 

275593 [ four to ]. . . 

[0074]The case where the image data of big size (for example. 4000 p.xels x 4000 pixels) 
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expressed with the LVb* color system is inputted by the picture input device 201 
mentioned above, and it is hereafter accumulated in the image holding means 101 by it is 
taken for an example. How to extract the outline of the object specified by a user from 
this image data is explained. 

[0075]Another example lineblock diagram of the image processing system which applied 
the outline extracting apparatus of claim 6 is shown in drawing 10. In drawing 10 , an 
image processing system adds the conversion process part 209 to the image processing 
system shown in drawing 6 , and is constituted. 

This conversion process part 209 has composition which outputs the corresponding 
image data of RGB color coordinates according to the input of the image data expressed 
with the L*a*b* color system. 

[0076]In this case, before the transmission treating part 203 transmits the image data 
sampled from the image holding means 101 to the memory 204 for a display, What is 
necessary is to send out to the conversion process part 209, to receive the .mage data 
changed into RGB color coordinates by this conversion process part 209, and just to 
transmit to the memory 204 for a display. 

[0077]The read-out treating part 214 of the extracting processing part 210 should just 
direct that sends out the image data read from the image holding means 101 to the 
conversion process part 209. and a conversion result is sent out to the tracking 

processing part 220. , 
[0078]In this case, corresponding to each pixel on the approximation outl.ne obtained by 
the interpolation processing section 212. as shown in g^wing_8, the image data of the 
pixel of the cross shape range is read from the image holding means 101 by the read-out 
treating part 214, and it is sent out to the conversion process part 209. 
[0079]According to this, the conversion process part 209 operates as the color system 
conversion method 121, changes the image data inputted into the image data based on 
RGB color coordinates one by one, and should just send it out to the mixed-colors ratio 
calculating part 222. 

[0080]Thus, the image data of the border area extracted by the border area extraction 
means 112 can be changed into the color system in which additive color -mixing is 
materialized, and the contour extraction process using a mixed-colors model can be 
presented. Thereby, also about the image data of the color system in which add.t.ve odor 
mixing is not materialized, the technique of Japanese Patent Application No. 4-275593 is 
applied, and it becomes possible to extract an objective outline automatically and 

precisely. . , . 

[0081]In this case, since what is necessary is just to change the image data 
corresponding to **** of the picture of big size part, When extracting an objective 
outline about the image data expressed with the LVb* color system etc., processing 
time does not increase substantially because of the conversion process to the color 
system in which additive color mixing is materialized. Since the storage capacity needed 
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in order to hold a conversion result is also small, it is fully realizable also by small-scale 
systems, such as a personal computer. 

[0082]If the color-coordinates-transformation processing at the time of transmitting a 
reduction image to the memory 204 for a display is omitted, the time which display 
processing of a reduction image takes can be shortened, and processing can be 
accelerated as a whole. 

[0083]Here, if the display device 205 likens the image data of an L*aV color system with 
the image data of RGB color coordinates as it is, for example and displays a reduction 
image the color which is completely different from an original color as a color of each 
pixel of this reduction image will be displayed. However, since a respectively different 
color is displayed on the field to which original colors differ, it is possible enough to grasp 
an objective rough outline intuitively. It is also possible to grasp similarly the pixel which 
shows the color corresponding to a color of object or a background color. 
[0084]By the way, an objective outline is a boundary line of the picture of an object.ve 
portion, and the picture of the portion of a background. 

In human being s vision, since it is regarded as edge of two fields where colors differ, if an 
objective outline is extracted based on the rate of change of the color in a p.cture it w.ll 
be thought that the outline caught with human beings feeling can be extracted fa.thfully. 

[0085]The variation of the image data in uniform color space here, Since it corresponds 
to the variation of the color caught with human being's feeling quite faithfully it » 
possible to evaluate the rate of change of the color caught with human be.ng s feeling 
based on the image data expressed with an L'aV color system, an L u v color system, 
etc 

[0086]Hereafter, it is ****** about the method of extracting an objective outline, using 
the character of uniform color space. The example lineblock diagram of the image 
processing system which applied the outline extracting apparatus of claim 8 -s shown .n 
drawing 11 . In drawing 11 . an image processing system is replaced with the track ng 
p^e^part 220 shown in drawing 6 , is provided with the tracking process.ng part 240, 

and is constituted. . . 

The read-out treating part 2,4 of the extracting processing part 2,0 has compos,t,on 
which sends out the image data read from the image holding means ,0, to th,s tracing 

nrocessing part 240. . 
This tracking processing part 240 searches for the coordinates which perform tracking 
processing mentioned later based on the image data inputted, and show an objective 
outline, and has composition sent out to the image process.ng port.on 230. 
[0087]In this case, the address calculation part 213 of the extracting process.ng part 210 
needs to compute the address of an applicable pixel by choosing the sample p.cture 
element for calculating color difference corresponding to the outline cand.date point 
corresponding to each pixel on the approximation outline obtained by the .nterpolat.on 
processing section 212. 
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[0088]For example, as shown in drawing 12 (a), this address calculation part 21 3, The pair 
of 4 sets of pixels which it left 2 pixels at a time to a scanning direction, a vertical 
scanning direction, and two diagonal directions focusing on the outline candidate point, 
respectively (in drawing 1 2 (a)) replacing the kind of shading to the pixel of each set with 
— having been shown — what is necessary is to choose as a sample picture element, to 
compute the address, and just to send out to the read-out treating part 214 
[0089]In the tracking processing part 240 shown in drawing 11, the color difference 
calculation part 241 is equivalent to the rate calculating means 132 of a color change 
described by claim 8. 

The image data of the sample picture element corresponding to each outline candidate 
point is received, and it has the composition of evaluating the rate of change of a color 
[ / near each outline candidate point ] based on the color difference computed from this 
image data. 

[0090]What is necessary is, as for the color difference calculation part 241, just to 
search for color difference from the image data of each class, respectively, when a pair 
of image data of 4 sets of sample picture elements shown in drawing 12 (a) is inputted 
corresponding to each outline candidate point, as mentioned above. For example, the 
color difference Dm corresponding to a scanning direction is expressed like formula ** 
using the image data (L\ a*,, b*,) of sample picture element **. and the image data (L 2 , a 2 , 
b* 2 ) of sample picture element **. 

Dm=(L* -L* ) ( 2 +(a*,-a* 2 ) 2 +(b*,-b* 2 ) 2 ) 1/2 ... ** ~ the color difference calculation part 241 
in a'similar manner in this case, What is necessary is to compute the color difference Ds 
corresponding to a vertical scanning direction and two diagonal directions, Dr, and Dt, to 
detect the greatest thing out of the color difference corresponding to four directions, to 
output ****** as a feature value corresponding to an outline candidate point, and just to 
send out to the maximum primary detecting element 242. 

[0O92]As mentioned above, in uniform color space, the distance between the image data 
which shows two different colors is proportional to the color difference caught w.th 
human being's feeling mostly. Therefore, if the greatest thing is detected out of the color 
difference acquired by the color difference calculation part 241 about each of the outline 
candidate point by the maximum primary detecting element 242 which showed diawmg 
11 The leading outline candidate point corresponding to the part where the color is 
changing most steeply is [ / near the pixel on an applicable approximation outline j 
detectable. 

[0093]For example, if the edge from which a color changes a lot is in a scann.ng direction 
near the outline candidate point shown by numerals ** in drawing 12 (b), The detection 
result of the purport that the color difference between the pixels which attach and show 
drawing 12 (b) shading as a result of having performed processing mentioned above about 
each of the outline candidate point surrounded and shown as a thick solid line in drawing 
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12 (b) is the maximum can be obtained. In this case, 3 pixels is the leading outline 
candidate point inserted into the pixel which attached and showed drawing 1 2 (b) shading, 
and it turns out that this 3-pixel either is the edge which divides an object and a 
background. 

[0094]Thus, what that determines a contour point from the obtained leading outline 
candidate point is the simplest as a method is making simply into a contour point the 
outline candidate point corresponding to the maximum of the color difference acquired in 
the maximum primary detecting element 242. 

[0095] Namely, what is necessary is to realize the function of the outline detection means 
1 14, to make the outline candidate point corresponding to the maximum of the detected 
color difference into a contour point, and just to send out the coordinates to the image 
processing portion 230 via the contour point attaching part 243 by the maximum primary 
detecting element 242. 

[0096]A contour point may be determined in consideration of the method of change of 
the color in the leading outline candidate point mentioned above. Another example 
lineblock diagram of the image processing system which applied the outline extracting 
apparatus of claim 8 is shown in drawing 13 . 

[0097]In drawing 13 , the tracking processing part 240 adds the contour point deciding 
part 244 to the tracking processing part 240 shown in drawing 11, and is constituted. 
This contour point deciding part 244 determines a contour point based on the detection 
result by the maximum primary detecting element 242, and has composition sent out to 
the image processing portion 230 via the contour point attaching part 243. 

[0098]In the contour point deciding part 244 shown in drawing 13, based on the detection 
result of the maximum primary detecting element 242, the image data reading section 
245 reads the image data corresponding to a leading outline candidate point from the 
image holding means 101, and has composition sent out to the color difference 
calculation part 246 one by one. 

[0099]In the contour point deciding part 244, the color difference calculation part 246 
computes color difference one by one based on the image data inputted, and has the 
composition that the decision processing section 247 determines a contour point, based 
on this color difference. 

[0100]For example, when the color difference corresponding to the outline candidate 
point shown in drawing 12 (b) by numerals ** is detected by the maximum primary 
detecting element 242 as the maximum, 2 pixels which adjoins this outline candidate 
point and scanning direction, and the pair of an applicable sample picture element are 
read by the image data reading section 245, and it is sent out to the color difference 
calculation part 246. 

[0101]If the color difference calculation part 246 computes the color difference ot 
adjoining pixels according to this, since the fine coefficient of a color [ / near the leading 
outline candidate point shown in the maximum primary detecting element 242 ] will be 
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obtained based on this color difference, a contour point can be determined based on the 
fine coefficient of this color. 

[0102]In this case, if the decision processing section 247, for example, makes a contour 
point the pixel from which the largest fine coefficient was obtained, the function of the 
outline detection means 1 14 can be achieved by the maximum primary detecting element 
242 and the contour point deciding part 244 which were mentioned above, and a contour 
point can be determined by easy processing. 

[01 03] According to this method, when the color of an objective portion and the portion of 
a background changes steeply, the edge which shows an objective outline can be caught 
sensitively and can be detected, but when change of a color is loose, it is easy to be 
influenced by a noise. 

[0104]It is good also as composition for which the decision processing section 247, on 
the other hand, integrates the rate of change corresponding to each of a leading outline 
candidate point one by one, and an integrated value makes a contour point the pixel 
which becomes the closest to 1/2 of the color difference between the sample picture 
elements located in both ends. 

[0105]In this case, even if the rate of change of color difference is loose, a certainly 
suitable pixel can be chosen and it can be considered as a contour point. The maximum 
of the difference of image data [ / near the outline candidate point ] may be calculated 
as a feature of the picture in a border area. 

[0106]The example lineblock diagram of the image processing system which applied the 
outline extracting apparatus of claim 9 is shown in drawing 14. In drawing 14 , the tracking 
processing part 240 is replaced with the color difference calculation part 241 shown in 
drawing 11 , and has composition provided with the calculus-of-fmite-d.fferences 
appearance part 248. 

About a pair of each of the sample picture element corresponding to each outline 
candidate point, this calculus-of-f.nite-differences appearance part 248 computes the 
sum of the difference of each ingredient of image data, and has composition which sends 
out that maximum to the maximum primary detecting element 242 as a feature value 
corresponding to an outline candidate point. 

[0107]This calculus-of-f.nite-differences appearance part 248 is equivalent to the rate 
calculating means 132 of a color change described by claim 9. 

For example, drawing 12 (a). According to the input of the image data corresponding to 
the sample picture element which attached and showed numerals **, it has composition 
which computes the sum S of the difference value of each ingredient based on formula 
**. 

[0108] 

S=|L*-L* 2 |+|a* -a* 2 |+|b* -b* 2 | - ** and this calculus-of-finite-differences appearance 
part 248* What is necessary is similarly, to compute the sum of a difference value, 
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respectively and just to send out to the maximum primary detecting element 242 also 
about the sample picture element of a vertical scanning direction and a diagonal direction. 
[0109]Here, since the sum of the difference value acquired by this 
calculus-of-finite-differences appearance part 248 changes almost corresponding to the 
size of the color difference corresponding to the pair of a sample picture element, it can 
evaluate the size of the rate of change of a color [ / near the outline candidate point ] by 
this difference value. 

[0110]Therefore, a result almost equivalent to the case where a contour point is 
determined based on color difference as mentioned above can be obtained by 
determining a contour point based on this difference value. 

[0111]In this case, since there is little computational complexity which calculation of a 
feature value takes compared with the case where color difference is computed, the time 
which the extracting processing of an outline takes only to that part can be shortened. 
By the way, if the pixel contained in the border area mentioned above is seen from the 
whole picture, it will be **** part, but when the size of the original picture is large, the 
pixel number is a too huge number. Therefore, in order to compute the feature value 
about all the outline candidate points contained in a border area, huge computation will 
be needed and the time which a contour extraction process takes will become long. 
[0112]Next, how to shorten the time which a contour extraction process takes is 
explained. The example lineblock diagram of the image processing system which applied 
the outline extracting apparatus of claim 10 is shown in drawing 15 . 
[01 1 3] As shown in drawing 15 , the extracting processing part 21 0 of an image processing 
system is replaced with the interpolation processing section 212 shown in drawing 6 , is 
provided with the sample extraction part 21 5, and is constituted. 

The tracking processing part 220 adds the interpolation processing sect.on 225 
equivalent to the interpolation means 1 15 to the tracking processing part 220 shown in 
drawing 6 , and is constituted. 

[0114]In drawing 15 , the sample extraction part 215 receives the coordinates of a 
designated point from the coordinate transformation part 211, makes a sample point at 
least one pixel on the approximation outline produced by contracting the pixel and 
designated point corresponding to these designated points, and has compos.t.on wh.ch 
sends out the coordinates to the address calculation part 21 3. 

[01 1 5]As shown in drawing 16 , this sample extraction part 21 5 extracts the pixel on the 
approximation outline shown by the dotted line as a sample point (shading was attached 
and shown in drawing 16 ) at intervals of 2 pixels, and should just send out those 
coordinates to the address calculation part 21 3, for example. 

[0116]Thus. when the address calculation part 213 and the read-out treating part 214 
perform read-out processing of image data based on the coordinate value of the sample 
point obtained by the sample extraction part 215 mentioned above, The funct.cn of the 
border area extraction means 112 described by claim 10 can be realized, the .mage data 



20/24 



Japanese Publication number : 07- 302342A 



of the outline candidate point corresponding to each sample point can be read, and it can 
send out to the tracking processing part 220. 

[0117]In this case, a contour point is discretely detected from the outline candidate 
point corresponding to each of the sample point discretely extracted by the 
mixed-colors ratio calculating part 222 and the outline primary detecting element 223 as 
mentioned above, and those coordinates are sent out to the interpolation processing 
section 225. 

[0118]According to this, the interpolation processing section 225 interpolates during a 
discrete contour point in a straight line, asks for a continuous outline, and should just 
send it out to the image processing portion 230 via the outline attaching part 224. 
[0119]The interpolation processing section 225 may interpolate during a contour point 
with a curve using a secondary curve, a spline function, etc. In this case, a smoother 
outline can be extracted although computational complexity increases compared with the 
case where it interpolates in a straight line. 

[0120]The computational complexity required in order to compute the feature value of an 
outline candidate point is substantially reducible by performing detection processing of a 
contour point discretely, as it mentioned above. For this reason, although the processing 
which interpolates a contour point is needed, since the computational complexity which 
interpolation processing takes is small enough compared with the computat,onal 
complexity required in order to compute the feature value of the outline candidate point 
corresponding to one contour point, it can shorten as a result the time which a contour 
extraction process takes. 

[0121]This becomes possible to shorten a users waiting time substantially, and the 
image processing system which is easy to use can be provided using small-scale 
systems, such as a personal computer. 

[0122]As mentioned above, with the tracking processing of a contour point, by 
performing extracting processing of a border area discretely, the time required in order 
to read image data from the image holding means 101 can be reduced, and a contour 
extraction process can be accelerated as a whole. 

[0123]When extracting the outline using the character of uniform color space, the 
invention of claim 10 can be applied and improvement in the speed of a contour 
extraction process can be attained. Another example lineblock diagram of the image 
processing system which applied the outline extracting apparatus of claim 10 is shown in 

drawing 1 7 . . 
[0124]In this case, in the image processing system which showed drawing 1 1 t he image 
processing system, Replace with the interpolation processing section 212, have the 
sample extraction part 215, and the extracting processing part 210 is constituted, The 
interpolation processing section 225 is added to the tracking processing part 240, and 
the interpolation processing section 225 has composition which sends out the contour 
point produced by performing interpolation processing of a contour point to the image 
processing portion 230 via the outline attaching part 243 based on the detection result 
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by the maximum primary detecting element 242. 
[0125] 

[Effect of the Invention]As explained above, with this invention, the image data of the 
border area containing an objective outline is extracted from the image data for one 
screen as an outline candidate point. 

Therefore, only a portion required for a contour extraction process can be read from the 
image data of big size, a contour extraction process can be presented, the time which 
reading of image data takes can be shortened, and improvement in the speed of a 
contour extraction process can be attained. 

[0126]By performing color-coordinates-transformation processing about the image data 
contained in a border area, The outline extraction art in which the mixed-colors model 
was used irrespective of the kind of color system showing image data, or the outline 
extraction art based on the rate of change of a color is applied, and it becomes possible 
to extract an objective outline automatically and precisely. By having limited the object 
of the color system conversion process to the border area, the time which a conversion 
process takes can be shortened and improvement in the speed of a contour extraction 
process can be attained. 

[0127]It becomes possible to obtain a continuous outline automatically and at high speed 
by interpolating between the samples of the contour point obtained by detecting the 
sample of the contour point corresponding to two or more sample points on an 
approximation outline. 
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[Brief Description of the Drawings] 

[Prawing 1] It is a figure showing the principle of the outline extraction method of claim 1. 
fDrawing 2] It is a figure showing the principle of the outline extraction method of claim 4. 
Drawing 3] It is a principle block diagram of the outline extracting apparatus of claim 5 



and claim 6. 

fDrawing 4] lt is a principle block diagram of the outline extracting apparatus of claim 7 
thru/or claim 9. 

fDrawing 5] It is a principle block diagram of the outline extracting apparatus of claim 10. 
fDrawing 6] It is an example lineblock diagram of the image processing system which 
applied the outline extracting apparatus of claim 6. 
[Drawing 7] It is a figure explaining how to specify an object. 

fDrawing 8] It is a figure explaining the extracting processing of an outline candidate point. 
[Drawing 9] It is a figure explaining contour tracking processing. 
[Drawing 10] It is another example lineblock diagram of the image processing system 
which applied the outline extracting apparatus of claim 6. 

drawing 11 ] It is an example lineblock diagram of the image processing system which 
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applied the outline extracting apparatus of claim 8. 
[Drawing 12] It is a figure explaining tracking processing. 

[Drawing 13] It is another example lineblock diagram of the image processing system 
which applied the outline extracting apparatus of claim 8. 

[Drawing 14] It is an example lineblock diagram of the image processing system which 
applied the outline extracting apparatus of claim 9. 

[Drawing 15] It is an example lineblock diagram of the image processing system which 
applied the outline extracting apparatus of claim 10. 

[Drawing 16] It is a figure explaining the extracting processing of a sample point. 
[Drawing 17] It is another example lineblock diagram of the image processing system 
which applied the outline extracting apparatus of claim 10. 
[Description of Notations] 
101 Image holding means 

1 1 1 Designated point input means 

112 Border area extraction means 

113 The feature evaluation methods 

114 Outline detection means 

1 1 5 Interpolation means 

121 Color set input means 

122 The 1st color system conversion method 

123 Mixed-colors ratio calculating means 

131 The 2nd color system conversion method 

132 Rate calculating means of a color change 
201 Picture input device 

203 Transmission treating part 

204 The memory for a display 

205 Display device 

206 Mouse 

207 Keyboard 

208 Input analyzing parts 

209 Conversion process part 

210 Extracting processing part 

211 Coordinate calculation part 

212 Interpolation processing section 

213 Address calculation part 
214,245 Read-out treating part 
215 Sample extraction part 
220,240 Tracking processing part 

221 Color set attaching part 

222 Mixed-colors ratio calculating part 

223 Outline primary detecting element 
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224,243 Outline attaching part 

225 Interpolation processing section 

230 Image processing portion 

241,246 Color difference calculation part 

242 Maximum primary detecting element 

244 Contour point deciding part 

247 Decision processing section 

248 Calculus-of-finite-differences appearance part 
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